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The educational accountability movement had been 
gaining momentum for at least f|ve years, some- 
times exerting massive effect on the educational process 
and educational funding. 

It seemed to be time for leaders in the movement and 
laymen to sit down with teachers ajtfd talk about it. 

This was the simple and straightforward reason for the 
National Forum on Educational Accountability, con- 
ducted in Denver, Colorado, on ftlpy 8-9, 1975. 

Since the use of the word "accountability* with respect 
to. education emerged into public consciousness a half- 
decade ago, much activity has centered about it. As 
numerous speakers at the Forum were to point out, 
thousands of articles have been written about accounta- 
bility; debate has flared about it; some form of accounta- 
bility has been written into the statutes of more than 30 
states and adopted by rule or regulation in still others. 
"Some form of accountability?" Aye, there's the rub. 
For, by and large, the educational experts were in fair 
agreement on the requirements of accountability. But not 

all who sallied forth under the banner of accountability 

/ 



paid much attention to these requirements. In some 
states, foir instance, an "accountability" law simply or- 
dered a statewide testing program in the basic skills, 
permitting the comparisons between schools and districts 
and groups of children which are anathema to many 
professional educators. In other states, broad gauge pro- 
grams were established which met all the requirements 
of tgjg accountability definition; and, as the states are 
diverse, so were these programs. 

4 

What are the elements of this common definition 
among the experts on accountability? A 
beginning-to-end logical process described in homely 
terms as follows: 

1. Decide where yoii want to go (in terms of goals, 
which are broad, and objectives, which are reachable 
subsets of the goals). 1 . 

2. Find out how far you are from reaching these objec- 
tives (through an assessment of needs). 

3. Decide what steps j^u^ should take (programs and 
strategies) to close the ^jalbetwe^n where you find you 
are and the objectives you)wnt to reach. 

4. From time to time, fe^sure your pXgress toward 
the objectives (through a^«|nent and evaluation). 

5. Calculate how much];itj^as cost to make that pro- 
gress. ' ; y ||| 

6. Report your findiftg| to^those Who .will make the 
decisions about how tafcst! til^trengthen the program's 
effectiveness the next timtji afMind (feedback and reqycle). 

Implicit in this process ^r^^Wo assumptions: first, that 
you are doing all this to improve the quality of education 
and increase the level of &tuaep$ achievement; and sec- 
ond, that your findings j Will \ b& used to make better 



informed decisions about how the educational process is 9 
to be improved in the future. 

None of which sounds reprehensible in itself. 

But there were problems. Some were shared by 
teachers and othpr education professionals— such as 
legislation mandating something they knew wasn't really 
accountability and that they thought might be harmful. 
* Such as the thinly veiled threat, here and there, that 
heads would roll as soon as assessment results came in/ 
Such as indications that state financing might be contin- 
gent on test results. 

Some problems were more specific to teachers, such as 
the fear, that theirs would be the heads set a«rolling 
I they are, after all, the front; line troops). Such as their 
indignation and concern that they weren't much involved 
in setting accountability systems— but they were to be 
deeply involved in implementing them. J 

Underlining these coficerns was the fact that the ac- 
countability movement did not start among teachers, nor 
even among school districts. Rather it came into being 
when the public, concerned about ever-rising school costs 
and, reports of poor student performance, began to de- 
mand, through their legislators, evidence of the actual 
effects of educational expenditures to support the school- * 
men's perennial prima facie argument that more dollars 
always equal better learning. 

Accountability in education subsequently was 
popularized by the U.S. Office of Education (USOEl; 
taken up as a cause by other groups who saw in it the 
possibility of a fetter educational bang for the buck; and J 
developed largely by state departments of education, 
under the impetus of federal grants, legislative demand, 
or their own interest. 



The U.S. ©ifice of Education and tlje state department* 
of education are not seen by most teachers as their 
staunchest allies. Legislators are seldom their favorite * 
people. So a lot of teachers didn't like what' they saw. 

They were to see more* of it, however. In 1972, with 
federal funding, the Cooperative, Accountability Project 
(CAP) was established: a consortium of seven states (Col- 
orado^ Florida, Maryland, Michigan, Minnesota, 
Pennsylvania, Wisconsin) formed to develop comprehen- 
sive guidelines, informational publications and model 
programs to assist state and local education agencies in 
making meaningful accountings of their efforts, both 
internally and for the public. I 

CAP proved effective in all three components of its 
mission— guidelines, publications, model programs. Ac- 
countability was becoming more widespread and more 
visible; and still teachers didn't think they were being 
permitted to participate properly. 

Teacher associations — national, state and local— began 
to rumble out warnings. Their general theme was this: 
Accountability programs had better be educationally ac- 
ceptable; teachers are not the only accountable people 
ijfrolved in education; teachers must not be evaluated, 
nor rewarded nor punished, on the basis of student 
achievement tests; and anyone who reajly wanted an 
accountability program to fly had better involve teachers 
in its development. 

& t about this time, the U.S. Office of Education was 
aTjL -inviting state representatives to Washington, one 
by one, to talk about a number of things, including 
accountability. 
It began to hear the alarnfbells. It perceived that all 
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^was not right with the world of aecopntability— and that 
J^rK^ps one of the principal reasons was the teachers' 
dl|f|&of nonpartieipation and their resulting latent hos- 

V WjitC prompting from teacher groups, USOE in 
November 1974 began to consider convening a P >rum at 
Which teachers, other education professionals, and con- 
cerned laymen could enter into substantive dialogue on 
accountability. USOE turned for particular assistance to 
three groups: the National Education Association (NEA) 
and the American Federation of Teachers (AFT!— the two 
organizations without 1 whose Cooperation any kind of 
teacher participation would seem shallow — and the 
Cooperative Accountability Project. • 
. It was soon agreed that there would be a National 
Forum on Educational -Accountability, sponsored by the 
U«S. Office of Education, and administered by CAP, with 
' the advice and assistance of the NEA and the AFT. 

Guidelines were also agreed on. First of all there was 
established a Steering Committee representing all the 
groups, which worked out the proportions of representa- 
tion, and agreed on the program format. 

Half the participants were to be teachers, selected by 
AFT and NEA, The other half represented a wide range 
Of interests: American Association of School Adminis- 
trators, -Association for Supervision and Curriculum De- 
velopment, Council for American Private Education, 
Education Commission of the States, National Assess- 
ment of Educational Progress, National Association of 
Elementary School Principals, National Association of 
Secondary School Principals, National Association of 
State Boards of Education, Performance^Based Teacher 
Education, Congressional Education Cbmmittee, Na- 



tional Institute for Education, U.S. Government Account- 
ing Office, National Alliance of Businessmen, National 
Association for the Advancement of Colored People, U.S. 
Chamber of Commerce, Urban Coalition; and various 
State Departments of Education and legislative re- 
presentatives. Parents and students also were to be re- 
presented. 

The format of the Forum was agreed upon. There were 
to be four principal topics, each to be introduced by two 
speakers — one presenting a tekcher-oriented point of 
view and one another view. After these presentations, 
participants were then to divide into small groups of 
about a dozen persons and attempt to find their areas of 
agreement and disagreement on the topic. They would 
then go back into general session to hear the next two 
speakers on the next topic, return to their small groups, 
and so on. 

For the smjall groups, facilitators were to be 
appointed — teachers with some experience in group dis- 
cussion, charged with the responsibility of keeping the 
talk moving forward constructively. Also each group was 
to have a recorder — a graduate student from one of the 
ne|^by institutions* of higher education — to write notes 
on the progress of the meetings and deliver them with 
comment to the writers q( the Forum report. Facilitators 
and recorders were to attend an opening training session 
conducted by experts in group process; thus fortified, they 

were to help the groups to decide and articulate their 
views on each topic. 

Consensus was the goal: What can teachers and non- 
teachers, sitting together in an informal atmosphere, 
agree on with respect to educational accountability? 

And so the stage was set. 
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In the latter-day spirit of bringing some good news and 
some bad news, Dr. Calvin M. Frazier, Colorado 
Commissioner of Education, opened the Forum with a 
quick review of the past five years in order to lay the 
groundwork for "a mid-decade evaluation of this educa- 
tional concept," accountability. 

Accountability has long been with education, he noted, 
from the early days when a teacher received room and 
board from parents in exchange for teaching their chil- 
dren. Such a teacher shifted his residency periodically 
from family to family— but "was always under 
scrutiny . . .it was a simple accountability cycle." 

From that simple cycle has grown an educational pro- 
cess in the United States with some 17,000 school dis- 
tricts, some two million teachers, some 45 million public 
school pupils. 

"The direct, simple accountability process of the early 
years has not been lost," Dr. Frazier said, "but it's safe to 
say that the process had been buried in an organiza- 
tional maze until Lessinger and others recently began 
suggesting this as a concept or idea that educators must 



add[regs— or face a further loss of credibility with the 
public. Thus begins our 'era of accountability " 

Accountability has made substantial strides, Frazier 
said: The federal commitment to it is deep and 
growing—^most federal programs require specification of 
objeetives^etivities designed to achieve these ends, an 
evaluationplan, and a reporting procedure" 

At the state level there is a great variation in ap- 
proach, he said, noting that while more than 30 states 
have enacted some kind of accountability legislation, still 
others have established accountability procedures^ 
through rules and regulations rather than legislation. 

He identified the principal accountability problems he 
has observed through Colorado's participation in the 
Cooperative Accountability Project as the following: 

• Legislators, once optimistic that accountability pro- 
grams would be the avenue to<deeper understanding of a 
major tax-consumer, are now inclined to be frustrated: 
"What mightj have been a means of improving the re- 
lationship beiween legislators and educators appears now 
to have become one more indication to some of the legis* 
lative skeptics that educators are fobt-draggers and not to 
be fully Crusted." . - " 

• Administrators feel threatened by a loss of lofeal 
autonomy under a system imposed by the state. I 

• Teachers find themselves on occasion the chief n> 
plementers of a system developed without th|eir 
involvemenWa little like sitting in the eye of the hur- 
ricane, knowing that you are soon to be pounded by the 
winds." • . 

• Students have been subjected to increasing numbers 
of tests— and sometimes to a subtle change in curriculum 
to reflect the more measurable objectives. 
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• "Long smoldering concerns about the sophistication 
of our testing programs have surfaced in recent years 

♦ because of the key role of evaluation in the accountability 
process/' 

Problems, yes— but, 'This conference is designed to 
bring together a cross section of professionals and 
lay leadership £o look at some of the issues. Heavy 
priority has been given to the involvement' of teacher 
representatives^ since it was felt that this voice was 
somewhat neglected in the past. Some anger and frustra- 
tion will sur^ce-^ajfld this is good, -if it can be a transi- 
tion to the resolution of some basie^problems." 

Dr. Frazier's introductory remarks did, indeed, 
foreshadow the direction of the conference: 

• The inevitablity of accountability 

• The difficulty of defining it, in light of its many 
applications * I 

• Discontent with tests. 

• The long non-involvement of teachers and teacher 
groups 

• The surfacing of anger and frustration* 

• And — perhaps — "a transition to the resolution of 
some basic problems/' * 

All unwittingly, his remarks may, too, have assisted in 
the early surfacing of anger and frustration. 

On the advance program, approved by the Steering 
Committee and distributed to Forum participants, his 
address was billed as "Greetings and General Orientation 
to Fortini." On the actual program, however, his address 

• was changed to "Accountability in Action" — a more sub- 
stantive title which indeed was mirrored in a substantive 
speech. 



This change was made with reason, but there were 
immediate grumblings that the Forbm would hear from 
three nonteachers before it heard from the first teacher. 
In the still tender and tentative rapprochement of 
teachers and others on the delicate subject of accountabil- 
ity, this order did not go unnoticed, but inspired a rumble 
of discontent that by day's end had grown to a roar. 

T'he reason for the change in program became clear 
^with the second speaker. This was to have been U.S. 
Commissioner of Education Terrel H. Bell, speaking on 
"Accountability in Action"— the subject on which Dr. 
Frazier spoke instead. This was because Dr. Bell, tied up 
in Washington, could not make it to the Forum. 

His place on the program was taken by Thomas J. 
* Burns, Actftig Associate Commissioner for State and 
Local Educational Programs, whose topic was "/ecounta-* 
bility: An Agenda for the Future." 

His central plea was for full participation in establish- 
ing accountability for the improvement of education. Not- 
ing the composition of the Forum, he said, "We have 
simulated each of the elements of a local community at 
this conference— but elevated its representatives by 
selecting their best leaders and national spokesmen." 

As have many spokesmen on the subject, he noted that 
•accountability is not new: "From decade to decade, the 
specific sense in which the schools are held to be account- 
able to the people shifts, but the principle of accountabil- 
ity remains unchanged." Today's sense of responsibility, 
he said, includes "responsibility not just for the student 
and his or her development, but also responsibility for 
the steady growth, development and performance of the 
teacher, principal, superintendent and community leader 
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who serve the educational enterprise." 

Again echoing other spokesmen, he referred to the 
many guises of accountability-^a condition ^he described 
ad appropriate to a participatory society. All opinions 
must be weighed, *he said— not that all are of equal 
validity, but because only in open dialogue can each be 
^weighed agajjoatjhej guchs tone of providing quality edu-- 
dation. T ^ * 

He proceeded to define the purpose of the Forum: 0 

'The challenge facing us during these next two days^is 
to identify* those components of accountability where our 
philosophies are compatible. Hopefully, this will provide 
a base from which other more controversial components 
can be identified and discussed with the aim of ameliorat- 
ing some of the differences. It just might be that many of 
our opinions are not as diverse as we suspect." i 

In approaching that challenge, Burns said, the Forum 
participants might penjeive that there is "... a common 
mood from which we can derive a common view about 
many of the expressions of discontent and demands for 
change that satellite thts concept of accountability . . . 
This new mood demands results-tpupil performance re- 
sults. 

"It demands that students learn as a result of the 
educational investment ... It is true that many stu- 
dents have been adequately served by our schools. But it 
also is true that some students have not been adequately 
served by our schools. And the public has the right to ask 
the question, my?' " 

He suggested that one reason for the public demand 
is the success of the American system in producing 
well-educated adults who know how to ask questions; and 



another reason might be "the Jong-held tradition in • 
American education of letting the public only yfrtf, way 
into the schools ... To respond to this disenchantment 
and move^beyond it to establish a new stability in public 
support will be difficult. It will require new candor." 

Bums defined the current goal as seeding "the highest 
quality of education at a politically feasible expenditure 
level. * 

"To be responsive to this challenge posed in an age of 
expanding technology « and endless innovation, the 
educator must be a full partner and participant of plan- 
ned change. The .educator must assume a flexible posture 
while being alert to opportunities for- adapting old 
methods to new needs, and must insure that such adapta- 
tion occurs. 

"For each change or innovation, there must be an 
arrangement to check whether improvement results. 
Something must be measured. Moreover, all the partici- 
pants' in such programs, should assist iu the design of the 
evaluation. Broad participation in the design of both 
innovations and their evaluation is essential if the work 
to be done is to become more rationally^related to explicit 
goals, and if, in turn, the goals themselves are to be 
realistic." 

Thus did the Acting Associate Commissioner— who had 
been centrally involved in the calling of the Forum — 
stand in ably for the absent Commissioner. Rut the 
absence itself lit a fuse that was destined to smolder for a 
bit— then leap into flame when further non-appearances 
of scheduled speakers seemed to denigrate the work and 
devalue the time of conferees whose nerves were wearing 
thin. It did not particularly help that all the no-shows 
were nonteachera. 
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Goals 
and 
,. Objectives 

With the last \yords of the prologue fading away — 
MrPBurns' closing question, "Can* we begin build- 
ing such an agenda during this coftference? ,, ---Dr. Arthur 
R- Olson, director of the Cooperative Accountability Pro- 
ject and director of tfce Forum, look the floor. 

He explained briefly how the Steering Committee had 
organized the Forurn around four topics: \ * ~ 

1. Goals and ObjectiVes 

2. By What Means Shall the Objectives Be^ Ac- 
complished? 

3. Assessment and Evaluation 

4. Who Should be Accountable to Whom and <, For 
What? 

The stage for each topic Woufll be set, Olson said, # by 
two speakers, one presenting a teacher viewpoint, the 
other the viewpoint from another perspective. Then the 
participants would break up into a dozen small groups to 
discuss the topic. In each small group; gt teacher would 
serve as a facilitator to keep the discussion moving in 
somewhat orderly fashion. In addition, each group was 
assigned a ^recorder to set down what its members said 



and what they decided. 

To aid their discussion/ all participants were provided 
Tprejfered notebooks containing, with other Forum mate- 
rials, copies of each speaker's planned presentation, and 
an outline of each topic with suggested # questions for 
discussion. The groups were also given forms on which to 
enter theiA judgments* including a summary form with 
'three headings: Things We Agree On, Things We Dis- 
agree On, and Recommendations for Narrowing Dis- 
agreements. ^ 

It was an orderly format, and one on which there was - 
*no objection or disagreement from the floor— yet. 

In accordance with the plan, the two speeches 0h the 
first topic were t^en delivered. ¥ s 

The first was by Charles W. Nix, Associate Commis- 
sioner for Alarming arid Evaluation for the -Texas 
Education Agency. (It might be kept in mind that he was/ 
the third consecutive nont^acher to address the Forurrrf 
with no teacher yet heard 'trratr'£^ t % t '-thi.8 time some 
teachers were becoming restive.) 

Mr. Nix gave a scholarly and distinctly directive sum- 
mary of the standing^rgoal8 and objectives in the~whoTe~ 
area of educational accountability. He outlined the con- 
cerns and the choices, and explained the choices he would 
make. * " 

He defined schooling as "an open system a series 
of interrelated working parts, which has certain things 
going into it (inputs), being treated in certain wajrs 
(processes)! and certain other things coming out as a 
result (outputs). This kind of system also has a feedback 
mechanism to describe these outputs, processes, and in- 
puts so that we can decide whether we need to make 
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changes an8 what kinds of changes would improve the 
performance t£ the system in attaining its results. The 
kind of system we have in schooling is a Very human one: 
teachers working clo&ely with their students, using mate- 
rials and time in planned ways, in order to bring about 
certain desired learning, results among the students . 1 . 
It is the outputs of the education system that are its goals 
and objectives. They deal with the question: 'Where do we 
want to get to? " 

Mr. Nix identified eight persistent concerns in the 
area of educational goals and objectives— and his 
recommendation on all but one of them: 

Concern 1: What's the distinction between goal|| and 
objectives? Recommendation: A goal is the broadest 
statement of expected outcomes, and an objective is a 
specific part of one of the goals. 

Concern 2: In terms of whose peHomanTe^houId"edu^ 
cational goajs.and objectives be stated— student, teacher, 
organization as a whole? Recommendation: "I find it most 
useful to. assume that goals and objectives of education 
are solely student learning outcomes, and that every 



othercondition we strive to br^ih^gab^t^f!^1ave teacfc 
ing, relevant teaching materials, sound administration, 
%nd adequate financing of education— are meana to the 
ends of student growth and development." 
Concern 3: What should be included in the goals and 
* objectives for schooling? Recommendation: The goals for 
schooling should cover all the various possibilities for 
learning which should legitimately be offered to students, 
and should avoid, including aspects of student develop- 
ment which are not feasible to offer. Some of the ele- 
ments of these goals will be intended to be mastered by 



all, or nearly all, students-^the core goals. In addition, 
the goals will contain a large number of elective elements 
which each student may or may not seek to accomplish." 

Concern 4: -It is relatively easy to gain acceptance of 
broadly stated goals Tor student learning in school, but 
harder to get agreement on more tangible statements 
about exactly what it means for a student to make 
progress toward one of the major goals. Recommendation: # 
None at the moment. 

Concern 5: Some goals lend themselves more readily to 
specific objective statements than others: "Those goals 
that express expected learnings in the'basic communica- 
tions and mathematics skills can be detailed more re- 
adily; those in. domains such as citizenship, esthetic ap- 
preciation anjd realistic self-concept give us considerably 
more trouble^ Recommendation: "We can benefit by de-* 
veloping detailed, specific objectives where this is feasi- 
— bier But we must— ber satisfied with less- quantitative- 
.statementsiof expected student learning in other equally 
important areas." * « | 

Concern 6: There is confusion about whether goals and 
objectives are statements of intended accomplishment or 
guaranteed outcomes. Recommendation: H It|is difficult, if 
not impossible, to guarantee results in areas of human 
services. No physician guarantees a cure, and no coun- 
selor guarantees to solve a client's problems. The other 
view of the role of objectives makes more sense to me, 
Those who carry out the process of schooling will do 
everything within their power and competence as pro- 
fessional practitioners to bring about this genuinely in- 
tended outcome, and will continuously strive to improve 
^ their- instructional methods if the outcome is not being 
produced." 
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Concern 7: Is the teacher solely responsible for bring- 
ing about the intended learning results among students? 
Recommendation: "The system of education is extensive, 
attd has, many working parts: the teacher, the staff of the 
campus .and the school district, the local board of trus- 
tees, the state legislature and the state education agency, 
the federal government, andi very importantly, the-sto-'" 
d^t.«^j^B^her parents. All of these elements com- 
bine, for better or for worse, as the total system of 
schooling aimed at bringing about studentlearning goals 
and objectives. Responsibility *s shared, and all members 
of the team must play effective roles if the results are ti> 
be attained.*' / 
Concern 8: Aire objectives to be criteria of mastery for 
the individual student, or for a specified proportion of a 
grou}p Of students? Recommendation: 'The objective can 
be; 'vj^y- useful as a target for mastery by the pre- 
tup^all^atotice*" — * — ■- — — 
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also gave the Forum further clear dis- 
[ tinctions between goals and objectives. 
■ Goals: "Those broad areas or domains of human 
knowledge, skills, competence, values and - attitudes 
which are judged to be appropriate outcomes of /a stu- 
dents participation in schooling. They are. the general 
directions, the broad avenues of development, /of the 
human character and intellect" j + 

Objectives: "Tangible statements of ljuman charac- 
teristics which are derived from these nonspecific goals 
V * * Objectives should be quantifiable and measurable, 
or at least, t obs|rvable on a systematic basis by a trained 
observer." lie s&t them, at three levels: The exit objective, 
to be attained djyer a multi-year jperiod such as by the 



time of exit from high scfiool; term or annual objectives, 
smaller incremeirflp of the exit objectives, intended to be 
accomplished in a* school year or term; and performance 
or behavioral objectives^he/mostTangible and measura- 
ble, intended, as^Kelearijii g outcome of a short unit of 

instruction, such as a week or a single class period. 

* Mr. Nix was equally- spe cific in his ideas about who 
sets goals and objectives. < 

"As to goals-^the state authority establishes goals for 
the gtate as a whole; the locijil authority adopts or amends 
ihese to fit its dwn community situation; the federal 
government has inpute; teachers participate in Setting 
goals, as do parents and students. Goals, however, "sim- 
ply must be put into place by an appropriate policy 
authority* They cannot be ifeft to individual decisions by 
students, parents, teachers! or other individuals who 
work in the educational system. Chaos would result." 



-As-to objectives— the-more 



they fall into th£ domain o 



Guidelmes might be: Exit objectives to be set by the 
administration of the local school district, in consultation 



with the teaching profession 



concrete they get r the-more- 



' the professional educator. 



term and annual objectives 



to^be-set-by the teachers,- working^ith the administra- 
tion; performance objectives to be set by the teacher, with 
advice from his direct supervisor, the students, and 
perhaps parents. / • \ 



The Forum participants*had k lot to chew on from Mr. 
Nix* thorough analysis. Many forgot to chew, 
as they heard immediately thereafter from the first 
teacher representative — Girard % Hottleman, Assistant 
Executive Secretary for Programs, Massachusetts 
Teachers Association*. * 



Those teachers in the audience who were expecting a 
statement of the teachers' position on accountability were 
surprised,' but could hardly be disappointed. Wh^t they 
.heard was a ringing defen se^ the child, and a sublime 
scorn for any accountability model which moved him 
Ao n! the center of power -as well as of attention. (And 
n, Mr. Hottleman made perfectly clear, applits to any 
^Pfountability model he had heard of.) \ 

His short but pungent speech was based on anWcient 
and effective method of argumentation: "There fretwo- 
opening possibilities. If you choose A, you must proceed 
here. If you choose B t you have given up this." (This was 
made manifest iii the title he chose for his address: 
"Setting Goals for Accountability Models— Problems in 
Sequence, Logic and Consistency.") 

He cheerfully announced himself an opponent of most 
of what has happened in the name of accountability— 
because everyone busily .started measuring before anyone 
defined what it was they wanted to be measured. 

What's education about, he demanded? Well, obviously, 
behavior modification. To what end? 

Some say to fit students to society. That means chip- 
ping away the rough edges^ of individuals until they fit 
the model. 

Some say to fit society* to students. That means chip- 
ping away the conforming influences of society until the 
necessary degree of individuality is reached. 

Those who see education as fitting the student to soci- 
ety will set up an hierarchical accountability model, 
respecting the rights of elders to make decisions for the 
young and working downward from a chain of command. 
That model tends to be specific and concrete. 

For holders of the opposing view, the" accountability 



model would "spontaneously generate from the students 
% and not the authorities. Outcomes would be individual, 
sanctions self-imposed, and tne system "responsible to the 
student rather than to those who currently create and 
run the system." •* . ; 

Hottleman left no room for doubt as to his position: 
"Education, is for the child ... the child has the righjt to 
decide what he ought to be. If education is truly child-^ 
centered then the parents, the teachers, various govern- 
ment establishments have^e right to enter* into di- 
alogue with the students, but r not to compel them into a 
prion molds . . . If we carry this logic to its inevitable 
end, the students would adopt goals, design* the cur- 
* riculum, hire the staff, and allocate the resources. As you 
can see, logic can lead to some strange places. That is 
probably, why we don't use too much of it."" 

Hottleman went on to define roles of others in child-'* 
, centered education. In fact, he defined them* Jhree 
times— in detail* in summary, and in tighter summary. 
Here is his second statement, the first level of summary- 
'The accountStfUity model would look something like 
this: Students wcWld set the goals and objectives for 
themselves. Teachers would coordinate the process >of 
individual goal-setting, and help translate this process 
into productive group activity. Administrators would 
coordinate resource distribution to maximize the 
achievement of teacher-student requests. School boards 
would work toward the creation of policy to free the 
individual from the control of others and to communicate 
the fiscal needs of the school district to other members of 
the community in order to achieve voluntary support for 
the costs of the process." ^ 

Forget about accountability models, Hottleman urged, 
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i itmtil you have determined the reality of the educational 
' model* "Let's (first of all design healthy schools and then, 
if there's som^ Value to it, let's go after the accountability 
Jsaue" . 

__ ' - , ,' • * % . „ 

•TP his all constitute^ a sufficient load for the Earvurf 

JL participant^ to carry into theii- first group sessions; 
12 groups, each with from a dozen to 15 members^ mem- 
bership carefully divided to reflect the overall Forum 
proi^rtion^ ^ " *f 

_^ TCh6y had heard where accountability stands today and 
how it got there; an agenda for accountability .in .the 
future; an analysis of goals and objectives as a starting 
point for accountability, and of special problems and 
Concerns about goals and objectives; and a broad attack 
on serving the wrong clientele. * 
Now, in theoi^, thfc small "jproups were to speijfd about 
' t nd a half hours discu ss ing Go i * 
Within this outlined framework:' 

At what level ^hduld goals be developed? (Na 
• tional, state, school distorted individual school building, 
other?) " t \ ":-V : * 

---<£: If goat development is important at more than one 
level Within a. state, should the goals fee identical, or 
nearly identical, at dli levels at which they .are de- 
yelbped? v . * . \ % 
^ST^What groups and individuals ahtitild have major 
; _i«8pon8|bility for determining goals for education? (Stu- 
dents, teachers, parents, other citizens, local boari of 
education, state board of education, state department of 
; education, legislatures, federal agencies, professional as- 
sociamOns, others?) In what role — as advisors, decision 
- makers* implementers? When in the process? 




4. How general (or specific) should goals for education 

b e ? : • .-. * 

What" groups and individuals should have major « 
^Sponllbility fot determining objectives for education? 

; ISapae sub-groups and spb-questions as above.) 

* . ' 6. What groups should have major responsibility for 
determining .school objectives? (Same group listing as 
above.) 

7. How specific (or general) should educational objec-N 
tives be? ■ ~* , ",\ 

8, Should objectives be stated in terms' Of behaviors 
expected of (a) administrators, (b) teachers, (c) students, 
in accomplishing them? \'\- \ \ 

9* If not in terms of the above, how should objectives 
be stated? 

10. If used, should behavioral objectives for teachers be 
quantified? If so, on what basis?, » - * 

~If^ot,Hhow^hould^ppropriate behavior be judged 

12. Should objectives be identical for all Students? If 
not, who should determine what are appropriate objec- 
tives for Which students? * ' 

13. Should objectives for administrators and any 
-others-be-explicitly stated at the outset? 

The theory cracked a bit from the beginning. In the 
first instance, the groups had only a bit more than 
half the allotted two and a half hours to devote to these 
subjects — a result of such usual conference exigencies as 
late starts, , long speeches, long lunch. In the second 
instance, a good number of the participants Weren't ready 
to deal with what to their minds were sub-questions.. 
They first wanted to talk about accountability, what it is, 
and whether they like it. 
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jh r $ V, IV .:' "V. A; • 

the goodwill cdmmon amohg those involved in 
u ^uMo^ho are asked to discuss something important, 
% Sf^ll^^^i^^ * suggestion* from a number of m 
^Uit^^^o^ of the ^ou^ plunged jnto the subject, 

Av^S^pM^^ ■ ■ . • * • v/* \* 

} • fariHtS^iven choices 'and gptiohs by professional - 
* ^w*^M^rrm be goals for their children, 

^ brinks^ 
^ %^heff^^corwnsui about uniformity of national ., 
goa&wn^ Should schools be held accountable « 
onlyfor^s^ measurable? * (Group 11) 

m No^ermi0jtihe rote of students in goal setting* even* 
in an, advisory there are problems of maturity 

• Whe n is a'itwfkt mature enough to take part in this 



\itingthern. (Group 5) 
\itives ultimately controls society. 



process? Ag* l&iM 6?(Gr6up 10\ ' # i 

.•1Af ih^Tiatia^jlevel, the goals are -the 3K* and^ 
healthy fe^^^ yk^^ desire for learning, and Self- 
concept. These l^^^he^ilentcitrriculum. (Group 5) « 

• jiacAertr doij^ov f /te gocrf* o/7A«r district because 
theyhaOe no part in 

• %he t writerdf dt 

jGroup5) \ 

• T^e ftufckrc infmnce in setting goals u the im 
portance of getting in% college or getting a job. (Group 5) 

• Goal^and objective* must come- from the bottom up. 

(Group 4) ' W \ * 

• Goals, should be general at the national level, less so 
at theMate level, and immediate and specific at the local 

UvelliGmp*) 1; 

• The federal government should not set goats for edu- 
cation, but priorities for immediate change. (Group 4) 



• # Goals and objectives should be set for each chili 
individudllyAGrovp 4) ^ 

• Not sure there should be goals ynd objectiues^but if* 

' we tnust hdve them, then goals should be mfjtekritly ■> 
~broa4~tKat a variety of conditions, such a^sbcioefotwrrtie. 

- ¥ fevel within 4 district, £an„ be accommodated without fotfi- 

'ing another operating level info conflict tGroup;3£ ' 

• If there are. to be* state pbjective*, they should be t 
minimum standards which tnaytbe exceeded. (Group 3) 

Consensus statement: Goals' should come frbm and 
\ exist at all kveli. , Objectives sjvould be set at git level** 

- Teachers should have tfU most input in determining per^ 
formbnce criteria and objectivesAGroup 2) 

• Goals should be set by the community that owns the 
6 school; (Al others (teachers, Barents, etc.,) should be advis- 
ory. Counter-statement: I disagree. Suppose the comma- 
nity just wants ^basket weaving, and „ no math or reading- 

. are we professionals to provide that? Response: Surisjorgo 

- to another school system more to your liking, (Group 10) 

• It doesn't matter what goats and objectives are set, 
^ since the actual decisiohs will be the result of political ■ 

considerations, (Group 1) 

• We should be problem centered, not goal centered. 
(Groupl) m \ 

• Parents are more concerned about their local schools 

. than about whether the state has goals. (Group 1) .. 

In the end, most of the groups were able to come to 
some consensus on outline questions 1 through 
7— those^ding with the usefulness, the setters and the 
specificity of goals and objectives. A reasonable sample of 
their conclusions appears in this summary statement of 
Group 10:. * , 



"Goals are necessary at all levels of operation and 
jehould be broad in concept. 

I "6oals at different levels should be broad enough to 
^accommodate all the varied goals developed at the next 
lower level. This requires that the goal preparation pro- 
cess begin at the lowest level and work upward, 

"At the community and/or district level, goals should 
b8 developed with the advice of feachers, students, par- 
ents, and professional associations. 

"Educational objectives should be-specific and reflect 
the needs t>f the community served. 

"Objectives, of necessity, cannot fee identical for all 
y students beyond the stage of early basic skills acquisi- 
, tion. Objectives establishing minimums should be de- 
veloped for all students, with modified objectives de- 
veloped allowing for the individuality of the student." 

While a good number of groups were thus developing a 
fair consensus on a number of questions, several warning 
signs emerged again and again. 

One was a feeling of constraint. Operating within the 
suggested structure, outline and forms, many groups be- 
lieved they were not contending with the hard and basic 
tiuestionsr-ln-addition, the groups were aWare that the 
time available was insufficient to address such complex 
issues. - 

And finally, there was a strong reaction against the 
proposed questions starting with Number 8. These got 
into the matter of setting objectives for teachers and 
administrators. They asked about the wisdom of, and the 
methodology for, quantifying behavioral objectives for 
teachers. They indicated to some a confirmation of their 
fear that accountability took aim on the teacher. Hackles 
began to rise. 
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FT 

Attaining 
Objectives 



Some of the small groups had by now completed the 
assigned work on goals and objectives. Most had not, 
but believed they could double up in their next dfeoussion 
meeting and address the fir^Tf^o topics together /"Here 
and there, in a few groups, w£*4 those who were opeVy 
dubious about whether it mUw sense to attack the pro- 
blems in the structured way^the outtine-oftopic-questiins- 
seemed to suggest. 

That attitude was soon to grow. But first the partici- 
pants were called back into general session to heaj the 
two speakers assighed to lead off the next topic: "By 
WhatMeahs Shall the Objectives Be Accomplished?" 

The first speaker was Grace Treible, an elementary 
school teacher from Newton, New Jersey, 

Ms. Treible took undeviating aim on the assigned topic. 
She went further, and broke it into the components which 
the Steering Committee had suggested as the outline for 
the small group discussions. 

The first two of these dealt with determination of 
teaching-learning strategies. And on this she was crystal 
* clear: 'Determining the teaching-learning strategies re- 



mains the prerogative of the teacher." £ 
Why? 

Among other reasons, because "It is the teacher who 
must deal on a daily basis with such dominant factors of 
human nature as man's need to feel success, man's ne#d 
to have-a^reason for being, and man's fear of being alone 
or different These factors allow for conformity and domi- 
nation. They present to the teacher the ever present and 
imposing challenge of providing security to creative hu- 
mans and groups while balancing the relationship of 
freedom and authority. 

'Teachers must deal witli the very important but more * 
measurable concerns of academic skills and their excels 
lence. Our culture demands the mastery of these skills if 
the individual is to be able to take full advantage of his 
potential. The mastery of many of these skills is not the 
natural activity which children strive to perfect. Cpn- 
sequently, psychological complexities arise." 
— While the teacher must set the strategies, Ms. Treible 
noted, "That is not to say that creative and appropriate 
ideas of students or parents or other groups should be 
ignored. Accepting appropriate suggestions is in itself a 
teaching-learning strategy." 

There are a number of self-appointed, instant au- 
thorities on education, she said, coming up with 4 bright 
ideas. Education is not the only profession suffering from 
this universal expertise, she said, but &dded, "it is some- 
what untenable to hold a teacher accountable for the 
implementation of someone else's bright idea." 

It is reasonable for local/state boards of education to 
want to expose their staffs to various teaching learning 
techniques, Ms. Treible said. Those so wanting must 
consider the generally acceptable routes: ^Appealing to 
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teacher preparation institutions to add graduate and 
undergraduate courses, providing supportive resource 
people, implementing in-service workshops, responding 
to the creative ideas of teachers, including teachers in 
materials selection, and encouraging, the involvement of 
teachers in such activities as this Forum. Teachers have 
the same basic needs as other humans/' 

There are many teaching-learning strategies, Ms. 
Treible said, because teaching is a complex process: 
"Teaching is the art and science of instruction which 
brings about learning in the pupil; it is what the teacher 
does, to inform and stimulate the/ learner. Teaching calls 
for originality, ingenuity and adaptability; it relies on 
the understanding of how'children in general learn and 
how particular students learn. It demands a constant 
diagnosis of what changes the current activity is produc- 
ing. Teaching is the ability to negotiate a balance 
between children as individuals and as members of con- 
stantly merging and emerging groups. These skills, pre- 
sently immeasurable, are all a part of the teaching art." 

She was to havfe been followed by Dr. Gordon Cawelti, 
executive director of the Association for Supervision and 
Curriculum Development, headquartered in Washington, 
DC. 

But Dr. Cawelti could not make it to the Forum — the 
second principal speaker to be absent. His speech was 
presented by Dr. Charles Speiker, a colleague at the 
ASCD. 

In his prepared remarks, Dr. Cawelti gave as the firm 
belief of the Association that "good curriculum construc- 
tion (which he related closely to accountability) cannot 
take place without authentic involvement of teachers, 



professionals and the community at large." 

Hid paper went on to address the question of meeting 
school objectives by analyzing stages in curriculum de- 
velopment, and selection of strategies for instruction^ 
change. Dr. Cawelti listed five, stages, with attendant " * 
problems, in curriculum development: 

1. Needs assessment This elicits viewpoints *and> 
priorities 'from teachers, school leaders/and citizens. But, 
! \ . . needs assessment invariably produces a top rank- 
ing for basic skills on the part of citizens, while pro- 
fessionals who work wittt children every day tend to be 
more concerned with the child's personal growth and 
societal maimers. In addition, thus" far the accountability 
movement has tended to place an inordinate amount of 
attention on basic skills without having, sufficient evi- 
dence to justify that this emphasis results in more pro- 
ductive citizens." 

2. Formulation of objectives. This often follows the lead 
of the needs assessment in over-emphasis on the basic 
skills. "I believe that more attention needs to be given to 
the fundamental purposes of schooling, with these pur- 
poses being more akin to broad goals than specific in- 
structional objectives. A major reason for the dis- 
enchantment of many young people with their schooling 
is that no one has stopped 1 to conceive of the broader 
purposes of schooling such as the true role of a school in a 
democratic society." 

3. Selection of an organized content The local school 
people rarely do this themselves — rather, they are in- 
volved in "the selection of instructional materials de- 
veloped at some remote publishing house or in a regional 
lab." 

4. Selection of an organized learning experience. This 



requires debate and participation by teachers, cither pro* 
fessionals, and the community. "|Iany parents do not 
appreciate the. advantages of open education simply be- 
cause they do not understand it. It is not the kind*of 
schooling they had, and it symbolizes to many a de- 
terioration of discipline knd other qualities th£y hope the 
professionals can teach better than the home." 

5. Specifying the evaluation model. Much good work 
has been done in this area recently, but "the accountabil- 
ity movement has fallen far short of adopting some of the 
newer evaluative techniques which have distinguished 
clearly the difference between formative and summative 
evaluations. Accountability experts have focused far 
more on summative evaluations, and, as a result, little 
improvement in the curriculum itself is derived from 

* evaluative data." 

Di^ Cawelti's paper also listed briefly seven viable 

— change-strategies: The research and development ap^ 
proach, community involvement, the systems approach, 
alternative schools, consortia of schools with similar 
interests, the traditional strong leader approach, arid 
humanizing the scKool climate. 

Thus fopfcifiedrthe Forum participants went back to 
their small groups to discuss the means of ac- 
complishing objectives. The Steering Committee s^ijtline 
proposed delving for answers to the following questions: 

1. What groups and individuals should be involved in 
determining the administrative/management strategies 
for accomplishing educational objectives? (Students, 
teachers, parents, other citizens, local boards of educa- 
tfon, state boards of education, legislatures, federal 
agencies, professional associations, others?) 



2. What groups and individuals should be involved in 
determining the teaching-learning strategies for ac- 
complishing the educational objectives? (Same-suggested 
groups.) 

3. To what extent should each group and/or individual 
be involved in determining appropriate strategies? 

4. How can the schools best be organized to accomplish 
the objectives? (Self-contained classrooms, team teaching, 
open classrooms, student contract, alternative schools, 
departmentalization, other?) 

5. What are the most important types of teaching 
strategies for accomplishing the objectives? (Didactic 
teaching, behavior modification, guided independent 
study, activities outside the school?) 

6. Should the strategies and methodologies be the 
same for all students? 

7. Are some strategies better for accomplishing some 
objecti v es than others ? Which ones? 

Some of the. groups gave it a game try— at least 
through the first three suggested questions. Typical 
statements from their discussions: 

• Society can determine the what — the goals; but 
teachers must determine ho to-the strategies. (Group 4) 

• There's a large assumption packed into the form of 
the questions— asking who sets administrative/ 
management strategies, and obviously looking for the 
answer, "administrator"; then asking* who sets teaching- 
learning strategy, and obviously looking for the answer, 
"teachers." As a teacher, I am a management expert too. 
(Group 10) 

• The textbooks are part of the strategy. Counter state- 
ment: That's part of the reason I don't see parents involved 
in strategy— witness what they're doing now in West Vir- 
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ginia about textbooks. Counter-counter statement: But 
they would do that anyway, whether we want to involve 
them in the strategy or not. Counter-counter-counter 
statement? The setting of school calendars is an adminis- 
trative strategy that surely requires parent input. (Group 
10) 

• Professionals have to determine the how and what 
(Group 9} 

• We couldn't agree on definitions-how muld we agree 
on the process? (Group 5) » 

• Consensus statement by Group 10: "Teachers, ad- 
ministrators, and local boards of education should have 
decision-making roles in determining administrative/ 
management strategies. Professional teacher associations 
may be involved in the decision-making process if neces- 
sary for negotiation purpose^; otherwise, these associa- 
tions, plus students aniPpctrents, should function in an 

h advisory capacity. ■ — — — — — — 

i "Teaching/learning strategies should be decided by stu- 
[' dents and teachers with advisory inputs from ad minis- 
I trators cmd patents at the local level. Teacher preparation 
I institutions must perform an advisory function and may 

| take^an active rote in decision making. ~ 

I "Strategies and methodologies should not be the same 
I for individuaLstudents or teachers." 
I But When it came to the rest of the proposed 
I questions — those asking which is the best way to achieve 
? this^ or that— almost unanimously, the participants 
f balked, 

jj, "All of the above," one said* "None of the above," said 
I another. ''Whichever works best " said a thircl. 
\ ' Group 10 put it politely: 

\ * "All Of the 'good, better, best and most? type questions 



were rejected by the group as being answerable only on an 
individual rather than a *group basis, and then only in 
respect to the experience and orientation of the individual 
^spondee." 

Others put it more bluntly: 

• We have come to no consensus. We can*t agree on 
anything. I think we all feel badly about our progress. If 
other groups are in the same condition we are, this Forum 
is in bid shape. (Group 6) 

• We have a lot of dissent, but little else to show for the 
day. We're questioning the very purpose of this Forum. 
Perhaps the best answer is just to forget about aecbunta~ 
bility once and for all. (Group 8) 

• This Forum is entirely too structured. It assumes that 
we are one step farther along than we find ourselves to be. 
The Forum is appropriate only if we have an authentic 
role here — do we? Even if we do, our dynamics don*t fit 

~ this structure (Group 10) ~ - ~ ~~ ~~ 

Something had happened during this first day of the 
Forum. In the beginning, -participants in the small 
groups tended to be defensive, sometimes even hostile — 
after allrthey were sitttng dov^ and^talktng abour^ititF 
thing in which all had stakes, and often different stakes. 
But as the' day wore on, they got to know one another 
better, to loosen up. Even when they couldn't agree, they 
found they could talk rather freely. But they weren't sure 
they were talking about the right things in the right 
order. Some felt that in discussing questions which were 
subsets of the large question of accountability, they 
% might be assumed to have some liking for accountability. 
The concerns were vexing. Happily, the Forum structure 
provided a channel to review concerns. * 



Reactions 
to the j 
First Day 



The Forum structure Called for an end to the first 
day's discussions at 5:45 p.m., followed by a meeting 
of facilitators and recorders with Dr. Olson, the- Forum 
director; Barbara Jones and Robert Campello, Jr., who 
had conducted the training sessions for facilitators; and 
members of the Steering Committee. The purpose was_to_. 
review the first day's work and see if any changes and 
improvements should be made for the second and final 
day. a * 

The facilitators made it perfectly plain that improve- 
— ment-was-neededv4nr an-intense .discussion, skillfully halt-.- 
subtly guided by the trainers, they recounted their ex- « 
periences and their frustrations. 

Many teachers within their groups, they reported, har- 
bored the suspicion that they had been gathered to en- 
dorse the concept of accountability and somebody else's 
notion of w]hat accountability is, at that. Others had 
complained that Jhe structure within which they were 
asked to* work didn't meet their needs or desires; that 
they weren't gating to the basic Questions; that whatever 
they saioVjnignt be distorted in the final Forum report to 



indicate there was much mo$e agreement than, existed. 

Echoing views expressed in the small groujp meetings, 
some facilitators questioned whether. this Forum could 
accomplish anything— whether it should not have been 
preceded by "another, at which common definitions and a 
common vocabulary could have been created. They won- 
dered what the teal motives of the U.S. Office of Educa- 
tion and of Dfe Olson had been in organizing it as they 
had. * ^ 

These <Jarlding suspicions were allayeii when two fcqh* 
resentatives of teacher associations and members of thfe 
Steering Committee, Dr. Bernard H. McKenna and 
Gerald F. Hagans, stepped forward and reminded them 
that £he Steering Committee had approved the structure 
of the Forum find the supporting forms. It wasn't an OE 
plot; it was the joint work of OE, NEA and AFT. Admit- 
tedly the Forum format wasn't perfect, and obviquBlyjit 
wasn't working as anticip ated— but that was jtuhnan pr* 
ror, not devious plotting. f j jf 

The facilitators were further mollified when they ^ere 
assured they didn't have to follow a rigid structure. j*The 
structure had been proposed as a starting point, as the, 
banks betifceen^wlikh^ 

some assurance that they were on the same stream as 
'"other-groups. But if they preferred to float without 
reference to these banks, they could. 

The facilitators were discussing whether and how they 
would use their newly discovered freedom when* Girafd 
B. Hottleman, one of the featured speakers of that morn- 
ing, entered the room with an announcement 

A group of teachers had just gotten together, he said, 
and asked him to notify the Forum officials that there 
would be a teachers* caucus the next day. 



24 



Hir announcement caused a flurry. What was it 
about? Was theTorum to be iprpedoed, at the very 
moment its leaders thought they had a notion of how to 
rescue it? Who-Mvhich group—had called for the 
teachers' caucu6? Who could ^and would attend? Where 
would it be? When would it be? 
When? .-. 

There was a problem. There just wasn't time for it, Dr. 
Olson pointed out, except during lunch. The Forum was 
to start at 8:30 a.m., with speeches and discudsipna urifil 
12:30 p.m. Then a one-hour break for lUncfr* Then a full 
schedule of speeches and discussions until 5 p.m., when a 
General Session would review^he meeting and look 
ahead to next steps. Then a lot of people had planes to 
catch, and couldn't stay around. So when could the 
teachers' caucus be held? v 

That surely seemed to be a problem, ftottleman agreed. 
But, willy-nilly, the teachers' caucus would be held.- 
Perhaps Forum official* could find some way to accom- 
modate this fact. If not, the caucus would be held any- 
way. 

On that note, Hottleman withdreW. The official crew! 
had one more problem to discuss — the unhappiness of 
some participants at inability tj> question the principal 
speakers. It was agreed that questioning time would tie 
provided on the morrow; and that those speakers of this 
first day who were still available would be askedf to op&n 
themselves to retrospective questions too. This, obvi- 
ously, would take more time dtt a day in which there' was 
already insufficient time. * 

A little time opened Up when it was announced that 
Dr. Leon M. Lessinger, a scheduled speaker for the next , 
day, could not appear. *« 
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Assessment 

and 
Evaluation 



For some, it was a long night. There were rump 
meetings; there were phone calls. There was even an 
early and amicable breakfast meeting'between spokes- 
men for the American Federation of Teachers and the 
National Education Association. 

There was accommodation without confrontation: so 
that, as participants gathered for the morning General 
Session," word was passed that a resolution of some im- 
portance would be available fot them to take with them 
to their following small groups; and that the teachers' 
caucus would start around noon — biting somewhat into 
the scheduled small group discussions, somewhat into the 
lunch hour. 

It was in a eh§rged and expectant atmosphere, then, 
that the scheduled General Session began. The topic was 
, "Assessment and Evaluation." 

And, at a meeting at which the unanticipated had 
already become commonplace, an unexpected thing in- 
deed happened here. The two speakers on jbhis most 
touchy topic were renowned experts in the field — both of 
whom asserted their firm and strongly based opposition 



to the more common types of assessment and evaluation. 
If one *were an achievement test, and if gne were to 
wander into that meeting, one would indeed feel friend- 
less. " , * 

The first speaker was Dr. W. James Popham, Pro- 
fessor of Education at the University of California at 
Los Angeles. He went directly for the heart of the matter. 

"Evaluation and assessment constitute the core compo- 
nents of any properly conceived program of edijcatioijaL 
accountability. To become accountable, educators must 
evaluate the* merits of their instructional endeavors: that 
is, the^' must systematically assemble evidence, which 
will permit others to judge the wortifcof thei| ^diXcational w 
efforts. By and large, the evidence used in such fcvalua* 
tions w^ll be assembled by using tests and other assess- 
ment devices." 

So the critical ingredient in accountability is evalua- 
tion, and evaluation's cKief vehicles are tests and mea- 
sures. All right, then, how good are tests and measures? 
Bad— for evaluation and accountability. 
Fine—for the purposes for which they were developed. 
These historically were to make comparisons be tween 
individuals so that the best-suited would be selected: e.g., 
in the* military, who would m&ke officers, or in colleges 
with more applicants than places, who would be admit- # 
ted. These tests, both aptitude and achievement, are 
norm-referenced tests, relating any individual's perfor- 
mance to that of an entire group for purposes of drawing , 
distinctions. 

What happens when such norm-referenced tests are 
used for purposes of evaluating school performance? Gen- 
erally, said Dr. Popham, three things— a}l bad: 
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1. Mismatch between te$t and curriculum* What is em- 
phasized in the schools of $illingfc, Montana, may not be 
emphasized in thpee of Detroit Test publishers try first 
t*> sniooth but tjtfe differences, then to gloes over them. 
'Buttheifea^ 

ftatai, hencfc spurious conclusions about the effectiveness 

& local ifcbool system's jjfograin,^^^^^^;" ; 
1 S& Inadequate mpr^ A good teat should 

poii&th^l^ ik a basic tenet of * 

educational evaluate th^ programs found wanting will 
either ^ 

"norm-referenced achievemeft ,t<^8 provide scaat guid- 
ing regf^ing how to mpi%Wlbadequate stuaeht per- 
iotmeMCte?* . . "f> : : S '-/, ;\^cj_:-"- 

=:* 3, Exclusion tofkey concepts. Good tei^t items are those % 
answered correctly by abotft jhalf the test-takers. An item 
answered correctly by a lot more than thatr-say» 80 % to 90 
.pe^ &nt^ it is of little vm in 

establishing dlfleretijoes. If teachers think a certain con- 
*cept important ^ and if their pupils do 

[well on. it in standardized teats, then the items regarding 
; that concept are likely to be dropped: - a bizarre situa- 
^tidto^Dh Popham said drily* ' : , ; - . /^^^Jh^ ' r: t /i-- 
; Sbijfie think salvation lies in criterion-referenced teats. 
? Th$y do to said— particularly • 
more descnfitiyi power. But there is more to having good 
criterion-referenced tests than merely wanting them, he 
said, warning Ins audience to be "prepared for some 
ptetty heroic huckstering by test publishers in the next 

Second speaker on this eventful morning was Dr. L. 
Wendell Rivers, director of the Mentar Health 



Specialists PfQgram at the University of Missouri— St. 
Louis. 

The controversy over testing has been' raging for some 
Seven years, he noted, and many of his colleagues think 
that not niuch has been learned during the years. : 

'However, I disagree,'* said Dr* Rivers, "I think that 
many factors have emerged which will help the classroom 
teacher and the School administrator to make accurate 
and critical decisions regarding the use of standardized 
tests?. .->;■. :• -.> : V- J ■ " ■ , • 

i; The distinction between standardized tests of in- 
telligence and standardized achievement tests is, at best, 
Vague and cloudy in respect to the abilities tapped by 

both. ;<V^ :-'yp^:,' 

2. The differences found between the scores achieved 
by urban Black children anclmiddle^class urban white 
children are test-related rather than genetically related; 

3. The allocation of funds for schools or districts cannot 
be based upon the scores obtained by minority children 
on standardized tests of intelligence or achievement. 

4. Traditional standardized tests of intelligence or 
achievement are not appropriate for use with a vast 
majority of urban and rural minority children. 

5. The accurate and fair evaluation of teacher effec- 
tiveness and performance cannot be based upon scores 
achieved by their students or on traditional standardized 
tests of achievement. : ;i_;r- ;. 

6. Tests' used with the population on which: they were 
standardized are fairly good predictors of academic suc- 
cess.; :" : : " "A . _ 

7. v Test developers and producers should be account- 
able for informing users as to the limitations of their 
assessment devices in regard to minority individuals. 



8. Negative labels given to children as a result of their 
performance on a standardized test produce far-reaching 
and persistent negative implications in the lives of chil- 
dren so labeled " 

In addition to these descriptions of tests, Dr. Rivers 
offered a list of questions, test-givers— such as schools — 
should ask themselves before they expose minority in- 
dividuals to any assessment device: 

1. .Why do I test? , % 

2. What informational, resources should I explore be- 
fore administering tests? 

3. What id the environmental makeup of my testing 
facilities? 

4. Are my testing facilities congruent with the natural 
environment of the person to be tested? 

5. What social/emotiorial conditions exist for students 
during the testing period? 

6. Are iny test results used properly? 

7. How should I interpret test results; what framework 
should be used? 

* •* 

The questioning that had been promised the previous 
night was desultory; nothing said to the two speak* 
ers on evaluation indicated any disagreement of import. 

Several of the previous speakers also took their jplace 
on the podium for questioning, with roughly* the same 
result— except for a close quizzing of Thomas J. Burns, 
U.S. Acting Associate Commissioner of Education. 
, Mr. Burns n%d to deny firmly that there was a hidden 
agenda— that *OE had hatched some plot in which they 
were all entrapped. 
But there might be a new agenda, he suggested: 
"Is this worthwhile? Can we talk about this issue five 



years after it surfaced? Would it have worked if we had 
talked before?" ^ 

Other issues would surface, he noted. For instance, 
within a year the federal government probably would be 
giving states from $100,000 to $1 million each to study 
their equalization formulas. (Public Law 93-380, Educa* 
° tional Amendments of 1374). 

Those grants and thofee studies, he predicted, would 
have "tremendous impact." Should Forums be called be- 
forehand to discuss this? What did they think? 
* It was something else to ponder as the conferees went 
off to their small group meetings. Their thinking affected 
the JTorum deeply. 

The small sessions were to discuss assessment and 
evaluation. 

Their tforum notebooks proposed that they address 
themselves to five questions: 

1. What should be the main purposes of assessment 
and evaluation? (Improvement of instruction, diagnosing 
individual learning difficulties, placement, determining 

/how well each individual student is mastering objectives, 
comparing students, comparing -classrooms, comparing 
school districts, comparing states, comparing educational 
programs, comparing educational poesonnel, other?) 

2. Who should determine appropriate assessment 
devices and procedures? (Students, teachers, building 
administrators, central office staff, local boards of educa- 
tion, state boards of education, state departments of edu- 
cation, educational researchers, legislators, others?) 

3. What are the most appropriate student assessment 
devices? (Standardized tests, criterion-referenced tests, 
individual diagnostic tests, teacher-made tests, COnfer- 
^SS* 
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encea with students, student performance; student prod- 
ucts, student self-evaluation, student peer evaluation, 

7* feicher professional judgment, other?) 

4 Who should apply student assessment devices? 
(Teachers/ specialists, counselors, principals or other ad- 

| miiuptfators, outside consultants, other?) 

5. Who should be mainly responsible for interpreting 
gnd using the results of assessment and evaluation? 
(Teachers, school administrators, parents/and other citi- 
zens, school britrds, state departments of education, 

" other?) * Jfc 

Some groups^jjifully attacked the proposed outline. 

i; Samples; >- 

* State assessment programs should not be mandated 

\ until the validity and reliability of measurement in- 
struments have been determined. (Group 8* 

\ • Assessmentis a professional responsibility, not a pub- 

\f~Oc: responsibility. (Group 12)^» ' 

[■■■■"' * Things we disagree on: There should be no statewide 

I plans for evaluation, (Group 6) 

r " need a needs assessment system that results from 
:^tke interplay between parents* teachers and students, 
(Group!) 

j • Things we agree on: The improvement of instruction 
i Mr Hie major purpose of assessment and evaluation. Stu* 
f dents, teachers, building administrator*, central office 
\ staff should alt help determine appropriate assessment 
I devices and procedures, dependent fin expertise. The state 
I arid researchers should serve as resource personnel. 
• (Group 9) 

[:. • Recommendations for Narrowing Disagreements: 
I Teacher professional judgment is the most appropriate 
% student assessment advice; principals, administrators and 



outside consultants should come into the process in very 
rare special cases; teachers and administrators should 
play cooperative but different roles in interpreting assess- 
ment (Group 9) 

But not all groups attacked the outline as- prescribed. 
In the first instance, they had beten assured the 
night befote that they were free to proceed in their own 
fashions. In the second instance, they had before them 
the resolution that had appeared at the doors of the 
Genera^jSession meeting room as they filed out. 

Inyfliejform in which they were given it, the resolution 
read' as follows: 

"Accountability is perceived as a shared responsibility 
by all of the parties involved in the educational milieu. 

"Given the constraints imposed by economic, social, 
political, psychological and cultural forces, the educa- 
tional practitioners cannot assume a role of accepting 
evaluation based on student achievement. 

"Legislators (federal and state), executives (federal and, 
state), school boards, state ' commissioners, educators, 
parent* and children all have responsibilities for dif- 
ferent aspects of the educational system. It is not possi- 0 
ble that an effective system can operate if any of the 
partners do not meet their responsibilities." 

Fairly mild stuff* appeared to be the participants' gen- 
eral reaction— -not the keg of dynamite they had been led 
to expect. Several groups debated the resolution and 
accepted it. Several others drafted proposed amendments. 
Some took it as a substitute text for the suggested discus- 
sion outline. Others took it as affair statement on ac- 
countability in general. But, before most^groups could 
take a firm position, the teachers' caucus had started. 



The 
Teachers'' 
Caucus 



The teachers' caucus* like the previously offered con- 
ference resolution^ appeared to most a niild affair. 
A resolution was presented, labeled a Joint Resolution. 
Joint as between whom was not stated; although,, from 
the prior discussions and the resolution wording, it ap- 
peared joint between National Education Association 
participants and American Federation of Teachers par- 
ticipants. It was debated briefly, mostly to clarify lan- 
guage, and was voted on* in the following form! 

"The United States Office of Education has been ac- 
tively conducting programs, publishing materials and 
funding projects on accountability for the past several 
years without the functional and significant involvement 
of the organized teachers, 

'The National Forum on Accountability conducted in 
Denver on May 8-9, 1975, was the first USOE program to 
obtain feedback^from teachers' organizations in any sub- 
stantial way. The short period of time provided* little 
opportunity to achieve large group consensus on the^ 
concept, definition and legitimacy of accountability. 
* "Therefore, the teacher participants of this conference 



urge that the USOE demonstrate its commitment to 
obtain input from teacher organizations by holding addk 
tional national forums on accountability and other educa- 
tional issues; allocating appropriate resources, providing 
adequate time frames and cooperatively developing pro- 
grams with the NEA and AFT^jrfno shall in all cases 
select their own xepresentatNces/ 

There was an attempt to amend th# second paragraph 
of the resolution to congratulate USOE for belatedly 
including teachers-— but it died a-borning as someone 
rose'to say he didn't want to be^ associated with any good 
word for USOE. 

As phrased, the Joint Resolution was put to the vote in 
a room with some 60 persons present, and passed with no 
discernible dissent, 

Noteworthy in the resolution were two features: 
I*. In criticizing the time frame for the Forum, it was 
criticizing NEA and AFT as well as USOE, for all^nree 
were represented on the Steering Committee that or- 
ganized the Forum. 2. It called for future Forums on this 
and other issues. This was the first clear "Yea* to Tom 
Burns' question, "Is this worthwhile^ 

(This interest in similar Forums was demonstrated in 
t^e post-Forum survey, reported fully in the closing 
chapter. One statement in the survey was, M I would like 
to be involved in designing future conferences of this 
kind/' To this* 84 percent of the teacher participants and 
76 percent of the nonteacher participants assented. On 
the statement, U I would like to participate in another 
National Forum on Accountability," affirmative answers 
were given by 100 percent o| teachers and 76 percent of 
others.) 




file day was wearing on, and the participants were 
wearing down. They came back into the afternoon 
General Session not quite sure what was going on— for 
instance, what had the teachers' caucus done? And What 
was to happen about the conference resolution they had 
seen that morning? And perhaps above all, how and 
when Would the Fo*Um end? 

It took some 45 minutes of scurrying around before the 
teachers' caucus resolution was read to the full Forum— 
-for 1 by this time the early enplaners had begun to drift 
out, and key people were missing.. Participants heard the 
resolution without noticeable astonishment, and settled 
back to hear the last two scheduled speakers. 

' ■ " 4 

The assigned topic wad, "Who Should Be Accountable 
to Whom an(f for AVhfttr Addressing it was Gerald 
F. Hagans, a high school teacher in Berrien Springs, 
Michigan, and a member of the Forum Steering Commit- 
tee. 

He addressed the participants as "friends of children," 
and spoke as one. 



Who is accountable? He treated the question With some 
bemusement: "Who is not accountable to our children's 
education? I think that if you would pursue the answer to 
this question, you would agree with me that we all share 
{ the responsibility to the education of our children." 

Acknowledging the good intentions of the founders of 
accountability— primarily the intention to improve the 
quality of education— Hagans said the whole movement 
has suffered becausi of ill-conceived or poorly im- 
plemented programs. / j > . 

"If seems as though the brunt of any accountability 
model falls the heaviest on the classroom teacher and his 
adniinistrator." v 

He conceded— and even gloried in— the fact that the 
teacher has a good deal to do with the child's education, 
with his success or failure. 'That's what the teacher is 
about. ■ ♦ ■ .' " v . 

But, "A source of frustration for teachers, who have 
sincerely tried to improve the means by which we edu- 
cate our students, is the fact that tare can only do so much. 
Teachers cannot do it alone. Teachers should not be held 
solely accountable. In fact, Ho particular group should be 
held solely accountable for the success or failure of a 
student or an accountability system. Some leaders have 
stated that accountability begins at the top, which is an 
erroneous statement. It is nice to think so* but in practice 
it simply is not so. In fact, I believe that at what level 
- accountability begins is irrelevant, because regardless 
where it begins, it simply does not work unless we all 
work together." ~ . * 

Hagans then ticked off some others, besides teachers, 
who must be held accountable, with some of the things 
they are accountable for: legislators, administrators, and, 



perhaps most importantly, parents and community. They 
are all needed. 

11 All of us are like pieces of a puzzle of accountability. If 
one or more of the pieces become lost or broken, then 
there is no solution to the puzzle. 

"As a footnote to this speech, I would like to raise a 
concern of mine. I am concerned about the outcome of 
this Forum, because someway, somehow, education in my 
classroom in Berrien Springs, Michigan^ as well as the 
classes of some two million other teachers can be affected. 
It is my hope that this^ Forum will mark the beginning of 
a revitalized effort of people working earnestly together, 
without ulterior motives, to -do what is best for our 
children." b 

Hagans was followe4 by Al Mayrhofer of the School 
of Education of the University of South Carolina, 
speaking in place of his absent colleague, Dr, Leon M. . 
Lessinger. 

He noted that Dr. Lessinger's paper had been dis- 
tributed to the participants, and commended it to tfieir 
attention. On the particular point at issufc— who is re- 
sponsible to whom?- the paper had this to say: 
* "The appropriate unit of accountability for results is 
the school and the school district. Accountability is a 
system concept^a set of mutual and interdependent re* 
lationships and functions to achieve a defined purpose. ,A 
teacher cannot be held solely responsible for results. He < 
or she can be held responsible only for knowing and using 
'good practice/ 

"By definition, good practice should yield positive rejf 
suits, tiver time— at" least three to five years--/ 
differentials in success by teachers of comparable clien- 



tele can be studied and system changes (i.e., Changes in 
resource allocation, training, methodology, e t tc.) can be 
made to improve the effectiveness of those not function- 
ing at optimal levels. 
* "A further word about accountability as a system con- 
cept is necessaiy here. The system nature of accountabil- 
ity implies a remarkable change in attitude toward the 
process of instruction. This is an attitude of system re- 
sponsibility for results. If the school as a system does not 
attain tlie objectives it sfets or that are set for it— if the 
students do not learn— the system is redesigned until 

they do. / 

"This redesign may involve upgrading^ training; new 
resources; improved methods; improved materials. Ee- 
gardless of the results, the students 4 or parents or 
teachers are not blamed for failure to learn. It is the 
system's job to get the required or desired results. If it 
does not, it is worked ofc— using the best of management 
techniques and strategy— until it does. 

"The system's responsibility for results is to its clients, 
the students and their parents, and to its patrons, the 
taxpayers and citizenry. It bears a particular, re- 
sponsibility to its employees also. As a well-managed 
organization, it must employ the best leadership prac- 
tices known. Fortunately, these include an emphasis on 
concern for human growth and fulfillment, as well as 
getting optimal results." 



And so, back to the small group meetings-rto ponder 
on who is responsible to whom for what, and to 
firm up positions on the conference resolution that would 
soon be before the Forum. 
The program suggested that the small groups consider 
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tKe Scheduled topic under these questions; 

1. In what ways should the "fffco'a" be accountable? 

2. What categories of groups and individuals should 
work together to establish a working relationship* 
between fiscal and program accountability? 

3; Should th6 school staff provide leadership in im^ 
proving conditions in the communis aa they relate 
'/:■■ to learning in school? 
^ 4. In what ways can the school work with other 
' agencies in th& community to assist students in 
becoming accountable for their progres^ in school? 

5. What types of motivation should be built into the 
accountability process for staff?, For students? For 
parents? For administrators? 

6. What types of penalties, if any, should be built into 
the accountability process for staff? For students? 
For parents? For administrators? 

7, What information is needed by various groups atid 
individuals in order to Carry out their roles in edu- 
cational accountability?, 

8, What groups or individuals are responsible for coor- 
dinating ail the elements of accountability— 
''putting it all together* 1 ? 

*l . " • «► 

Finally* the Steering Committee packet suggested the 
small groups complete a matrix of responsibility— listing 
thfc "^a^s'* (goal setting, strategy determination, rlass- 
room conditions/ etc*) down the left side tod the possible « 
^WWs* (Students, teachers, parents, etc.) as column 
! headings, and neatly matching one set with the other* 
I Only One group-^Group ^attempted to complete the 
matrix. Most of the groupe also declined to try to answer 
the proposed questions for this final discussion session. 



Rather, those who responded at all said, for the most 
* part and very simply, that everybodyas accountable— and 
that nobody should be punished. Samples; 

• A precedent* condition to teacher accountability i$ 
parental accountability for the child's mental, physical 
and emotional readiness to learn. (Group 3) 

• The purpose of accountability i$ not to place blame, 
but to improve education. (Group 3) 

• There must be mutual ticcountability in conditions^ 
and resources. (Group 3) ^ 

•Everyone is and should be aecouritable-4he objective* 
should be reasonable, and the conditions of accountability 
under the control of the one held accountable, (Group 2) 

• Everyone can be accountable; but the focus must be oh 
the progress of the pupil. (Group % 

0 m Any accountability system highly evaluative of the 
teacher hurts teacher morale* (Group 1) ^ 

• Some parents meet th&ir responsibilities; some don% - 
. (Group 1) • ; - - - V '' . ' . ' ' 

• Students are accountable for attendance and re* - 
ceptivity. (Group 8) 

• Prevent scapegoating, rewarding and punishing. 
(Group 10) : . V ' ; V '^:''"\';'. :\ ' . . 

• Our goal is shared responsibility. We agree that'edu* 
cation has not been adequately funded. In summary, we 
disagree on the very concept of accountability; on the 
question whether we can measure meaningfully; on who is 

* accountable for what; on the whole hierarchy of goals and 

* objectives; on whether we should evaluate programs rather 
than people, (Group 6) 

• The following list of impacts on education should be 
considered in describing accountability plans: THe in* 
centimes and resources in the plan for innovative behavior; 
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the. changes in the distribution of decision-making power; 
i the changes generated in the type and quantify of informa- 
nt tion available to teachers, administrators and the public; 
and the probable public relations aspects of the accounta- 
bility plan under consideration. <4?Group 10) 

f X nd so back to the closing General Session, for the 
last planned business of the Forum— review and 
preview, and the last unplanned happening— treatment 
of resolutions th A had emerged free-form. 

First, the conference resolution. In the form in which it 
was finally presented to the Forum, it read as follows: 

"Accountability is perceived by participants in the Na- 
tional Forum on Educational Accountability as a shared 
responsibility by all of the parties involved in the educa- 
tional milieu: legislators (federal and state), executives 
(federal and state), school boards, state commissioners, 
educators, parents and children all ha v e responsibilities 
for different aspects of education. It is not possible that 
an effective system can operate if any of the parties do 

- not meet their responsibilities. 

"Educators can be held accountable for that portion of 
the teaching-learning process over which they have con- 
trol. Educators' competence cannot be evaluated on the 
basis of student achievement because of the multiple 
variables which affect learning, caused by economic, so- 
cial, political, psychological and cultural factors, and the 
limitations of existing standardized achievement tests." 

It took a little while to get the resolution in that shape 
before the Forum. Nobody was quite sure whether they 
were operating under Roberts" Rules of Order and voting, 
or whether they were expressing a Forum consensus. In 
the end, it turned out that the vast majority didn't care 



all that much which— they just wanted to proceed, say 
their say and go; so they operated under whatever con- 
vention seemed most suited to the moment. 

There was a flurry over the adverb "primarily." Some- 
one offered it as an amendment, so that the affected 
sentence would read, "Educators' competence cannot be 
evaluated primarily on the* basis of student achievement* 
etc." Seeming acceptable, "primarily" was adopted by a 
vote of 55-34. t , 

Someone then had second thoughts, and asked Dr, 
Bernard H. McKenna, who had played a significant role 
in the conference^ what he thought about that. The 
McKenna response was short and to the point: "With that 
word 'prmiarily' in there, teachers will be ha3? 

After some parliamentary maneuvering of doubtful 
Robertsism but undeniable effectiveness, the offending 
word "primarily" was expunged* 

Then there was a counter-resolution to the effect that 
some number of participants didn't agree and believed 
that "the performance of educators should be evaluated, 
in part, by valid evidences of student progress," Again 
some parliamentary accommodation; and finally a vote 
that permitted 17 persons to agree with the counter- 
resolution. 

And so the main resolution passed by an overwhelming 
voice vote.* 
Now it was mop-up time. 

A number of chosen participants took the floor to say, 
among other things, the following: 
Despite a shaky start, it turned out to be a good 
meeting . . . Where we are to go depends on who we 
were when we came in . . . Education is a fantastic 
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operafion~~if the Office of Education wants to know 
what's going on it should check more with teachers . , ♦ 
We've learned that, rather than unravel disaster, it 
makes sense to solve our problems ahead of time . 
There is no lessening* of the thrust towar^ accountability 
... We hope someone will reconvene same such Forum 
to, continue this dialogue «v . We. werl just getting to 
know one another and work well together . , * If there is 
to be another national meeting, there should be pre- 
meetings at home in the states *. .. * We need some 
Systematic process to review what we do and to establish 
priorities . . , We are in a process of renewal and im- 
provement. ' \ ' ' . : ; r " V. • 

And representatives of a number of the sinall groups 
came forward to report their resolutions, their consensus, 
their urging that such Foru^ be held in the futurfcon 
accountability and other matters important to^education, 
because, somehow or otbAi*. they worked, 

And* finally, there was the resolution of thanks-^- 
considered obligatory at most such gatherings, but some- 
thing of a surprise at this one* And it, too, paid tribute to 
the value of such For»ms; 

"Be it resolved that the i>artieipants of the Forum 
extend their thank* and appreciation to all those re- 
sponsible for planning and facilitating the National 
Forum on Educational Accountability held in Denver, 
Colorado, on May 8-9, 

"Be it further resolved that the basic idea of the Forum 
(i*e., that educators and Jay citizens alike, holding dif- 
ferent points of view, can solve mcybr educational issues 
Wheii given the opportunity for dialogue, discussion and 
decision making) can be a model for future conferences/* 

It passed unanimously. * 
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Epilogue 



Preceding chapters have outlined what was said and 
what was done at the National Forum on Educa- 
tional Accountability. The report is subject to human 
error in observation and reportage; it was subject to the 
possibility that part of the recprd was made in the heat of 
the moment rather than in mature reflection. 

How closely did the flow at the Forum reflect the 
mature judgments of those participating? 

To find out, the Forum arranged for a post-survey, 
conducted by James Gold, Archie Buchmiller and their 
colleagues at the Wisconsin Department of Public In- 
struction. 

4 The preliminary survey draft was reviewed by mem- 
bers of the Steering Committee and others. The final 
draft was sent to 159 Forum participants, with a follow- 
up letter sent after two weeks to those not yet replying. 

In the end, 83 replies were received— 31 from teachers, 
46 from others (termed non-teachers in survey reporting)! 
and six from persons not identifiable in either group. 
These six were eliminated from the analysis conducted in 
Wisconsin, which concentrated on identification of points 

a 



of agreement and disagreement between teachers and 
non-teachers. The complete Wisconsin analysis is » pre- 
sented after a set of observations by the Forum reporters. 

Differences: Teachers and Others \ 

The Wisconsin analysis points out many areas \of 
agreement between teachers and non-teachers. T^e 
Forum reporters remain impressed, however, with k 
reading of the survey that confirms a central Forum\ 
observation — that even when teachers and non-teachers 
agree, they are inclined to dp so with very different 
emphases and priorities. 

To test and demonstrate this difference despite some 
similarity, the following methodology was applied to sur- 
vey results. 

Positive responses (Strongly Agree and Agree) were 
totalled. From these were subtracted negative responses, 
(Disagree and Strongly Disagree). The result was a Raw 
Positive Score, ignoring the two neutral positions (Un- 
decided or No Answer) r An arbitrary cutting point of 25 
was selected: Any statement on which the Raw Positive 
Score of teachers was 25 or more different from the Raw 
Positive Score of rion-teachers (even though the two 
groups might agree in general thrust) was isolated. 

This methodology revealed the two groups were 25 or 
more percentage points apart on 24 of 58 statements — 
somewhat more than 40 percent. This included 10 of 14 
statements in the "Accountability: General Considera- 
tions" section of the survey^~a bit more than 70 percent. 

Section 1: Forum Evaluation 
Statement 7: Participants with different points of view 
about the issues of accountability were adequately rep- 
resented. Both groups agreed, the teachers more force- 
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fully. Baw Positive Scores: teachers 64, notvteachers 30. 

Statement 14: The Forum was successful in meeting 
its goals. Both groups are agreed; the teacher Raw Posi- 
tive; Score was 42, the non-teacher 13. 

Statement 15: If given the opportunity, I would like to 
participate in another National Forum on Accountability. 
Again, both groups would— the teachers with a Raw 
Positive Score of 100, non-teachers with 68, 

Section II: Accountability — General Considerations 
Statement 1: Accountability is necessary for restoring . 
public confidence in and support for the schools. Teachers 
minus 19, non-teachers 66. 

Statement 2: Accountability is a means of informing * 
the piliblic of the purposes of education. Teachers minus 
13, non-teachers 67. * 

Statement 3: Accountability is a means of informing 
the public of the Outcomes of education. Teachers, minus 
22; non-teachers, p7. 

Statement 4: Accountability has generally had an ad- 
verse effect on tethers. Teachefrs, 78; non-teachers, & 

Statement 5: Accountability has generally had an ad- 
Verse effect on administrators. Teachers, 39; non- 
teachers, minus 39. 

Statement 6: Accountability has generally had an ad- 
verse effect on students. Teachers, 32; non-teachers, 
minus 37. 

Statement 7: Accountability for student performance 
is inevitable. Teachers, minus, 16; non-teachers, 53. 

Statement 8: Any accountability process must include 
* a measurement strategy. Teachers, 39; non-teachers, 81. 

Statement 11: An accdtihtability process must ulti- 
mately include evaluation of student learning. Teachers, 
9; non^teachers, 74. 



Statement 14: Professional personnel must have con- 
trol over the factors which influence the results for which 
they are accountable. Teachers, 94; non-teachers, 69. 

Section IV: Goals and Objectives 
Statement 7: State educational goals should! be derived 
by synthesizing local district goal's. Teachers, 25; non- 
teachers, minus 13. 

StatemenjL13: Goals and objectives are too restrictive 
and tend^ft dehumanize^ the educational process. 
Teachers, minus 16; non-teachers, minus 65. 

Statement 14: It is possible to create a set of goals and 
objectives which would not be dehumanizing. Teachers, 
62; non-teachers* 93. 

Statement 15: Because most states have a constitu- 
tional responsibility for education, each should have a sei 
of goals and performance objectjyes for all stu^pntsin the 
state. Teachers, minus 30; non-teachers, 9, 

Statement 16: The public has a right to expect that all 
students leaving school will be capable of demonstrating 
certain minimal competencies. Teachers, 18; non- 
teachers, 65. 

Statement 17: There should be several levels of 
learner objectives ranging from program to instructional 
objectives. Teachers, 55; non-teachers, 83. 

Statement 18: Educational objectives with perfor- 
mance criteria should be developed for all classroom 
activities. Teachers, minus 52; non-teachers, minus 11. 

Section V: Educational Assessment 
Statement 2: The? public desires pupil assessment type 
information. Teachers, 35; non^teachers, 64. 

Statement 4: Despite 'recognized limitations of tests 
(any type) the results should be used by educational 
decision makers since no Other student achievement in- 
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formation is currently available. Teachers, minus 45; 
non-teachers, minus 3. 

Statement 5: Student assessment results should not be 
used in evaluating professional personnel. Teachers, 91; 
non-teachers, 12. 

Statement 6: Student assessment results should not be 
used as one of several components in a total professional 
personnel evaluation system. Teachers, 35; non-teachers, 
minus IB. 

Match-up: Observation* and Responses 

The survey provided an interesting check on a number 
of central observations made by the recorders and the 
reporters during the course of the Forum. Several of 
these are discussed briefly. 

Observation 1: Forum Format 
Criticism of the Foriim format loomed large at the end of 
the first day. Complaints ranged from an unspoken as- 
sumption that educational accountability was acceptable 
to all, to a sense of restriction from discussion of the basic 
issues. / * , y 

Yet the\ survey response to the Forum was /fVer- 
whelmingly positive (Section I, Forum Evaluation"). The 
Forum was judged to- be fair, informative and well con- 
ducted; ^understanding was developed and the possibility 
of future advance accepted; most participants would like 
to do it again. On the negative side, relatively few said 
their opini|n§Jiad been changed as a result of the Forum. 

Observation il: Acceptance of Accountability 
Protests were heard from the beginning that accountabil- 
ity seemed to be" accepted as good and inevitable— while 
some participants doubted the premise strongly. 

The survey bore out this observation. Teachers and 



non-teachers had a Wide divergence of opinion on jnosfc of 
the pertinent questions '(Section II, Accountability-^ 
General Considerations). Apparently there can be no safe 
conclusion that teachers accept accountability. 

Observation HI: Goals and Objectives J t 
Reporters and recorders drew the observation that there 
was general agreement: Goals are broad and ought to be 
established by all those concerned; objectives should be 
narrower and are in large part a professional re- 
sponsibility. 

The survey tended to bear out this observation. (Sec- 
tion IV, Goals and Objectives). There were interesting 
dichotomies. Thus, while broadness of goals, was acknow- 
ledged in Statement 1, Statement? 4 won , concurrence 
with the criticism that goals are too general to have 
steuficant meaning. There also appeared in the survey a 
lac&spf agreement about the participation of the state in 
goal formation. In fact, there was doubt about the wisdom 
of having state goals. * 

The Survey 

There follows a report of survey results and brief sum- 
mary analyses made* by James Gold, Archie Buchmiller 
and their colleagues at the Wisconsin Department of 
Public Instruction. 

Survey questions are reproduced with the percentage of 
teachers (T) and non-teachers (NT) responding on a 
5-point scale. The scale, as abbreviated, is to be read: 

SA - Strongly Agree D - Disagree 

A o Agree SD - Strongly Disagree 

U = Undecided NA = No Answer 

(Note: Some lines do not add up to" precisely 100 per- 
cent because of rounding.) 
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FORUM EVALUATION 
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1. Participating in the National' Foaim on Educational Ac- 
countability was a productive experience. 
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5. The Forum format facilitated the sharing of ideas be- 
tween participants on the issues of accountability. 
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6* Including speakers with contrasting views contributed to 
the small group discussions, ' 
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7. Participate with different points of view about the is- 
sues of accountability were adequately represented. 
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8« t had sufficient opportunities to express my individual 
concerns about the issues of accountability during the dis- 
cussion sessions. L 
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9. The facilities provided for the group sessions were 
adequate. 
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10. Participation jgHJiis Foaim helped resolve some of the 

questions 1 had about accountability. 
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11* Participation fn the Fpmm motivated me to change my 
opinion on several accountability issues. 

12. I left the Forum with some worthwhile infonniation that I 
could share with my colleagues. 

13. I would like to be involved in designing future confer- 
ences of this kind. 

14. The Forum was successful in meeting its goals. 



15. If given the opportunity, I would like to participate in 
another National Forum" on Accountability. 

16. As a result of the Forum, I have a better understanding 
of which aspects of accountability people agree and dis* 
agree on. 

17. » As a result of the Forum, I feel better prepared to work 
with others in attempting to narrow the differences which 
exist concerning accountability. 



SUMMARY: Forum Evaluation 
Both teachers and non-teaehers responded positively to 
the overall evaluation of the Forum. Over 80% of the 
participants felt the Forum was a productive experience 
and that they would like to help plan and participate in 
any future efforts. In terms of results, it was apparent 
that although a majority of participants felt they had 
gained valuable knowledge at the Forum and would like 
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to participate in another one, less than half were moti- 
vated to change their opinion concerning accountability 
issues. Finally, nearly a third of the participants were 
undecided as to whether the goals of the Forum had been 
met. This response may be due to the fact that nearly a 
third, also, felt they had not received adequate informa- 
tion about the purpose and scope of the Forum prior to 
arriving in Denver. 



ACCOUNTABILITY; GENERAL CONSIDERATIONS 



i ^Accountability is necessary tor restoring public confi- 

; « 2* Accountability is a means of informing the public of the 
purpose of education* - 

3 5 Ac^uhtdbilify is a means of informing the public of the 
outcomes U educatton^ 

4r A^ had an adverse effect on 

teachers, 

& Adx>untabilHy has generally had an adverse effect on 
administrators. • * 

0v Ac?coUhtabilrty has generally had an adverse effect on 
students. 

7. Accountability for student performance is^ inevitable. 



8* Any accountability process must include a measure- 
ment strategy, ^ 

a Arty accountability process must clearly describe who is 
accountable for Whet 

10. Arty accountability process must be cooperatively de- 
veloped by all those affected. . 

t;l : Ah accountability process must ultimately include 
:• evaluation of student (earning. 0 
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iSL An accountability process must recognize that many 
individuals and groups are responsible for the education of 
students and that each must do his part. 

13. Accountability is intended to improve futoteprocesses 
and will not be effective if used (n a punitive rtpmer. 

14 Professional personnel must have contr&l over the fac- 
tors which influence the results for which they are account- 
able. 
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SUMMARY: Accountability— General (J6n$ideration$ 
Participant responses on this section of the survey re- 
vealed some of the key similarities and differences which " 
teachers and non-teachers discussed at the Forum. iPirst, 
non-teachers felt more, strongly than teachers that ac- - . 
countability is a means of providing the public with 
* information about the purpose and outcomes of schooling 
which is needed for ^storing public confidence in our , 
schools. Second, non^teachers believed accountability in- 
evitably involved student learning and performance, 
while teachers were less likely to agree or were un- 
decided. Third, teachers believed that accountability has 



in general had an adverse effect on teachers, adminis- 
trators and students. While^42 percent of the non- 
teachers believed that teachers were adversely affected, 
relatively few felt the same about administrator's and 
students. The two groups diet agree (1) that accountabil^ 
ity should be cooperatively developed by those affected, 
and (2) that any accountability program must recognize 
that many people have responsibilities in the education 
of students so that it is essential everyone do his part; (3) 
that an accountability process must clearly describe wrho 
is accountable for what, and (4) that accountability will 
not be effective if used in a punitive manner. 



BY WHAT MEANS SHOULD EDUCATIONAL OBJECTIVES BE ACCOMPLISHED? 
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; SUMMARY: By % Whkt Means Should Educational Ob- 
jectives ife Accbtnplishfdf 

The results of questions regarding the means of ac- 
complishing objective^ indicated a great deal of agree- 
ment between teache^ and non-teachers. Ot> each of the 
four questions teachers were identified as the group who 
should be most involved. Students were ranked second on 
each question except for the one dealing with cost/benefit 
analysis where both groups rated local boards second. 

The results of this section should be considered some- 4 
what tenuous since the administrators category was' in- 
advertently omitted from the choices. Where they do 
appear in the results they were a deled by the respondent 
in the "other" category. 

I 



SUMMARY: Goals and Objectives 
Nearly 90 percent of all respondents agreed with the 
definition of goals presented in the survey while approx- 
imately 70 percent of them thought that goals should be 
established at both the state and local levels. 

From a development standpoint there was general 
agreement that goals and objectives are somewhat dif- 
ficult to develop and that some sort of consensual process 
which incorporates the opinions of all groups involved 
should be used. Most respondents felt that goals should 
be based on broad concepts (human relations, basic skills, 
etc.) which cut across the traditional course offerings. 

Only about a third Of the teachers but only 11 percent 
of non-teachers believed that goals and objectives Were 
restrictive and tended to dehumanize the educational 
process. Furthermore, 68 percent of the teacher and over 
90 percent of the non-teachers felt that it is possible to 
create a set of goals and objectives which would not be 
dehumanizing. Over 60 percent agreed that some school 
outcomes should be described in terms of student experi- 
ence rather than student output. ^ > 

As a group the respondents tended to agree thatjeduca- 
tional objectives and performance criteria should not be 
developed for all classroom activity. But over 75 percfcn| 
of the non-teachers and 50 -percent of the teachers af- 
firmed that the public has right to expect that all 
students leaving'dchool Will be capable of demonstrating 
certain minimal competencies. 



GOALS AND OBJECTIVES 
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3. Ectucaltohat goals are important for identifying the pur- 
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6. There is little drfferenoe in the educational learner goate 
dither between or within states, 
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7, State educational goals should be derived by synthesiz- 
ing local district goals* 
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ft. It is desirable to develop state goais through some % 
consensual process Which Incorporates the opinions of ail 
groups Ihivd process* ' : 
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7 9^ Goals should be based on currteular areas such as 
reading mathematics, science. 
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10. Goals should ba based on broad concepts (such as 
human relations* self-concept; economic understanding, 
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basic Skills) whfch cut across traditional currfcular offerings. 
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1 1 . The importance of goals lies in the way they Sire trans- 
lated into objectives. 

12. Educational objectives at the state or local level are 
difficult to derive. 

13. Goals and objectives . are too restrictive and tend to 
dehumanize the educational process. * 

14. It is possible to create a set of goals 'and objectives 
which would not be dehumanizing. 

15. Because most states have a constitutional responsibility 
* for education each should have a set of goals and perfor- 
mance objectives for all students in the state* 

16. The public has a right to expect that all students leaving 
school wHI be capable of demonstrating certain minim 
competencies. 

17. There should be several levels of learner objectives 
ranging from^progracLto instructional objectives. 
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18. Educational objectives with performance criteria should 
be developed for all classroom activities. 

19. Some outcomes of schooling may be better described 
in terms of student experiences rather than student output 
objectives, | ' 
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EDUCATIONAL ASSESSMENT 



1. Educational pupil asse^ment Is a necessary part of. 
accountability. 

the public desires pupil assessment type information. 



3: The state of the art In measurement practice is such that 
no decisions should be made solely 'based on achievement 
test scores. 

4. Despite recognized limitations of tests (any type), the 
results should be used by educational decision makers 
since no other student achievement information is currently 
available, 

5. Student assessment results should not be used in 
evaluating professional personnel. * 

6. Student assessment results should not be used as one 
of several components In a total professional personnel 
eveiuatk>h system. 4 

7* It is possible to build controls so that pupil assessment 
data will not be misused, either against pupils or pro- 
fessional personnel. 

& Alternative methods of assessment to norm-referenced 
testing should be used to assess students, (e.g. teacher 
evaluation, self-evaluation, simulation, etc.) 
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SUMMARY: Educational Assessment 
Most respondents recoghized the problems with testing 
and responded negatively to the idea of using test results 
as the boU basis for educational decision making. Over 50 
percent of all respondents felt pupil assessment was a 
necessary part of accountability but teachers did not feel 
the public wanted Jfchis kind of information as strongly as 
non-teachers. Non-teachers felt more strongly than 
teachers about using student achievement information in 
the evaluation of professional personnel. Both groups 
agreed that alternative methods of assessment should be 
used to assies student performance. " 



SUMMARY: Speaker Evaluation 
The final section of the Survey asked participants to rank 
the speakers on a 5-point scale in two particulars: overall 
quality of presentation, scored from 1 (low) to 5 (high); 
and usefulness of information for small group discussion, 
scored from 1 (not useful) to 5 (highly useful). 

There follows a report on the scores given the speakers. 
(Note that in some instances they were not "speakers"; 
they could hot attend the Forum, and had their speeches 
£ead or their views expressed by others.T6peaker i is thq 
One with the highest scote on quality, of presentation, and 
so on. 
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